Skip to content

[spark] Spark write supports 'full-compaction.delta-commits'#6364

Merged
JingsongLi merged 2 commits into
apache:masterfrom
Zouxxyy:dev/compcat-delta-commits
Oct 9, 2025
Merged

[spark] Spark write supports 'full-compaction.delta-commits'#6364
JingsongLi merged 2 commits into
apache:masterfrom
Zouxxyy:dev/compcat-delta-commits

Conversation

@Zouxxyy
Copy link
Copy Markdown
Contributor

@Zouxxyy Zouxxyy commented Oct 8, 2025

Purpose

Spark write supports 'full-compaction.delta-commits'

Tests

API and Format

Documentation

/** Write a row to the writer. */
void write(InternalRow row) throws Exception;
@Nullable
SinkRecord write(InternalRow row) throws Exception;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

SinkRecord is not public API, should not return it here.

Copy link
Copy Markdown
Contributor

@JingsongLi JingsongLi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@JingsongLi JingsongLi merged commit 81ceea9 into apache:master Oct 9, 2025
25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants